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(54) A cache coherency mechanism 

(57) A computer system has a processor, a cache 
and a main memory. A cache coherency mechanism en- 
sures that the contents of the cache are coherent with 
respect to main memory by the provision of cache co- 
herency instructions which each specify: 1 ) an operation 
to be executed on the contents of a location in the cache; 
and 2) an address in main memory. The operation is ex- 
ecuted for the contents of the location in the cache which 
could be filled by an access to that address in main 



memory if the executing process normally has access 
to that address in main memory, regardless of whether 
or not the contents of the specified address in main 
memory are held at that location in the cache. 

This provides an extra degree of freedom because 
it is not necessary for the cache coherency operation to 
be requested in respect of a particular address stored 
in the cache. The instruction can specify any address 
which would map onto that cache location. 
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Description 

The present invention relates to a cache coherency mechanism. 

As is well known in the art, cache memories are used in computer systems to decrease the access latency to 
5 certain data and code and to decrease the memory bandwidth used for that data and code. A cache memory can delay 
aggregate and reorder memory accesses. 

A cache memory operates between a processor and a main memory of a computer. Data and/or instructions which 
are required by the process running on the processor can be held in the cache while that process runs. An access to 
the cache is normally much quicker than an access to main memory. If the processor does not locate a required data 
io item or instruction item in the cache memory, it directly accesses main memory to retrieve it, and the requested data 
or instruction item is loaded into the cache. There are various known systems for using and refilling cache memories. 

In order to rely on a cache in a real time system, the behaviour of the cache needs to be predictable. That is, there 
needs to be a reasonable degree of certainty that particular data items or instructions which are expected to be found 
in the cache will in fact be found there. Most existing refill mechanisms will normally always attempt to place in the 
'5 cache a requested data item or instructions. In order to do this, they must delete other data items or instructions from 
the cache. This can result in items being deleted which were expected to be there for later use. This is particularly the 
case for a multi-tasking processor, or for a processor which has to handle interrupt processes or other unpredictable 
processes. 

A computer system may have more than one processor, and each processor may have its own cache. Alternatively, 
20 a processor may have a plurality of CPUs, each with its own cache. However, these caches will commonly access a 
single main memory resource. 

Figure 7 illustrates a case where there are two processors CPU1.CPU2 each with their own cache 
CACHE1.CACHE2. The caches share a single memory resource MEM. Figure 8 shows what can happen in such a 
situation. Consider an address in main memory 101 0. This maps onto cache location 10 in both CACHE1 and CACHE2. 
25 The value V 3 stored at address 1010 had an initial value of X, and the value V 3 = X was initially stored at cache location 
10 in both of the caches. At that stage, the data item V 3 was "visible", that is either processor accessing address 1010 
would retrieve from its cache the value V 3 = X. However, the CPU1 has executed a process, modified the value V 3 = 
Y and returned this to the location 10 in CACHE 1 . Now, the value V 3 = X in main memory is "dirty" - it no longer reflects 
the current value of V 3 . Moreover, the value V 3 = X in CACHE2 is "stale" - it differs from the true value. Clearly, this 
30 situation needs to be rectified before CPU2 attempts to retrieve V 3> because otherwise it will wrongly retrieve V 3 = X. 

Thus cache coherency control is required to ensure that several processors and devices can correctly share mem- 
ory. This can be achieved by: 

1 . Automatic coherency. Additional hardware guarantees that loads can retrieve the most recently written value 
35 regardless of which processor or device wrote it. Note that a functional, but low performance, implementation of 

automatic coherency is to disable the cache. Such additional hardware is referenced COHERE in Figure 7. 

2. Software coherency. Special code sequences are used in the program to control the transfer of data between 
cache and memory. They allow precise control of coherency and efficient use of the cache. 

40 . 

The visibility of data depends on whether the cache is automatically coherent or not. If the cache is not automatically 
coherent then only the contents of memory and its own cache are visible to a processor. Software has to cooperate to 
ensure that data is written to memory when appropriate. If the cache is automatically coherent then the most recently 
written value by any processor will be visible to all other processors. 

45 

Visibility definitions. 

Visible A data item is visible to a processor if a load from the data item's address will return that item. 
50 stale A data item is stale if the value in the cache is different from the last value written. 
Dirty A data item is dirty if it has been modified in the cache with respect to main memory. 

In a situation where a process wishes to clear a location in the cache, but the process does not have access to 
55 the address stored at that cache location, existing software coherency techniques require usage of a special, privileged 
mode of processor operation termed kernel mode. In a normal user mode it is not possible in such a circumstance to 
render the cache coherent using software coherency techniques other than by transfer into kernel mode. 

According to one aspect of the present invention there is provided a cache coherency mechanism in a computer 
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system comprising a processor, a cache and main memory wherein a plurality of addresses in main memory have 
access to each location in the cache, wherein a process being run by the processor includes a cache coherency 
instruction which specifies (i) an operation to be executed on the contents of a location in the cache and (ii) an address 
in main memory, the operation being executed for the contents of the location in the cache which would be filled by an 
access to said address in main memory, if the running process normally has access to said address in main memory, 
regardlessof whether or not the contents of the specified address in main memory are held at that location in the cache. 

The contents of each cache location can comprise an address in memory and an item stored at that address in 
main memory. The whole or part of the address in main memory can be held. The item may be a data item or an 
instruction. 

The cache coherency mechanism defined above has the advantage that it is not necessary to request the cache 
coherency operation to be executed on a particular address stored in the cache. The instruction can specify any address 
which would map onto that cache location, and the processor can execute the instruction if it would normally have 
access to that address. Thus, any protection modes are automatically taken into account because, if the executing 
process does not have access to the specified address in main memory of the cache coherency instruction, the cache 
'5 coherency operation will not be executed. 

One type of cache coherency instruction is a flush instruction which writes back to the address in main memory 
held at that cache location, the item held at the cache location. 

Another type of cache coherency instruction is a purge instruction which clears the contents of that cache location. 
The cache coherency instruction can specify a sequence of addresses in main memory and operate for the contents 
of a set of locations in the cache which would normally be filled by accesses to the addresses in the sequence. Alter- 
natively, a sequence of cache coherency instructions can be executed, each specifying one address in main memory. 

The cache can be partitioned into a plurality of cache partitions, wherein the cache partition containing the relevant 
location in the cache is determined in dependence on the specified address in main memory. More details of a particular 
cache partitioning implementation may be obtained from our earlier Application No. (Page White & 

25 Farrer Ref. 77642). 

The main memory can be organised in pages, each page comprising a sequence of addresses. In that case, the 
cache coherency instruction can specify a page in main memory for which the operation is to be executed, the operation 
being executed for each of the sequence of addresses in the specified page. 

In that case, if the number of addresses in each page is always greater than the number of locations in one of the 
cache partitions, it can be determined that a cache partition can always be fully cleared by specifying a page. 
The cache, or each cache partition, can be direct mapped. However, other associativities are possible. 
The invention also provides a computer system comprising: 

a processor for running a process by executing a sequence of instructions; 
3$ a main memory which holds said instructions and data for said instructions; and 

a cache connected in a memory access path between the processor and the main memory and having a plurality 
of storage locations, wherein a plurality of addresses in the main memory have access to each storage location, 
wherein the sequence of instructions for execution by the processor includes a cache coherency instruction which 
specifies (i) an operation to be executed on the contents of a storage location in the cache and (ii) an address in 
the main memory, wherein the specified operation is executed for the contents of the storage location in the cache 
which could be filled by an access to said specified address in main memory, if the running process normally has 
access to said address in main memory, regardless of whether or not the contents of the specified address in main 
memory are held at that location in the cache. 

4 * The invention further provides a method of modifying the coherency status of the contents of a cache with respect 
to items held in a main memory, wherein a plurality of addresses in main memory have access to each location of the 
cache, the method comprising: 

executing a cache coherency instruction which specifies (i) an operation to be executed on the contents of a 
so location in the cache and (ii) an address in main memory; 

responsive to said cache coherency instruction, executing the specified operation for the contents of the location 
in the cache which could be filled by an access to said address in main memory, if the running process normally 
has access to said address in main memory, regardless of whether or not the contents of the specified address in 
main memory are held at that location in the cache. 



30 



55 



The invention further provides an instruction set for a computer system which includes a cache coherency instruc- 
tion which specifies (i) an operation to be executed on the contents of a location in a cache and (ii) an address in main 
memory, the cache coherency instruction causing the specified operation to be executed for the contents of the location 
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in the cache which could be filled by an access to said address in main memory, only it the running process normally 
has access to said address in main memory, regardless of whether or not the contents of the specified address in main 
memory are held at that location in the cache. 

In the preferred embodiment, the processor has a user mode of operation and a privileged (kernel) mode of op- 
s eration. Cache coherency instructions are executable in the user mode. 

For a better understanding of the present invention and to show how the same may be carried into effect, reference 
will now be made by way of example to the accompanying drawings in which: 

Figure 1 is a block diagram of a computer incorporating a cache system; 
io Figure 2 is a sketch illustrating a four way set associative cache; 

Figure 3 is an example of an entry in a translation look aside buffer; 
Figure 4 is a block diagram of the refill engine; 

Figure 5 is a diagram illustrating the operation of a multi-tasking processor; 
Figure 6 is a diagram illustrating the alteration in caching behaviour for the system of Figure 5; 
is Figure 7 is a block diagram of automatic coherency control; and 

Figure 8 illustrates 'stale' and "dirty" data items. 

Prior to describing a cache coherency mechanism, there will first be described a cache architecture within which 
the mechanism can be implemented. 

20 Figure 1 is a block diagram of a computer incorporating a cache system. The computer comprises a CPU 2 which 

is connected to an address bus 4 for accessing items from a main memory 6 and to a data bus 8 for returning items 
to the CPU 2. Although the data bus 8 is referred to herein as a data bus, it will be appreciated that this is for the return 
of items from the main memory 6, whether or not they constitute actual data or instructions for execution by the CPU. 
The system described herein is suitable for use on both instruction and data caches. As is known, there may be separate 

25 data and instruction caches, or the data and instruction cache may be combined. In the computer described herein, 
the addressing scheme is a so-called virtual addressing scheme. The address is split into a line in page address 4a 
and a virtual page address 4b. The virtual page address 4b is supplied to a translation look-aside buffer (TLB) 10. The 
line in page address 4a is supplied to a look-up circuit 12. The translation look-aside buffer 10 supplies a real page 
address 14 converted from the virtual page address 4b to the look-up circuit 12. The look-up circuit 12 is connected 

30 via address and data buses 16,18 to a cache access circuit 20. Again, the data bus 18 can be for data items or in- 
structions from the main memory 6. The cache access circuit 20 is connected to a cache memory 22 via an address 
bus 24, a data bus 26 and a control bus 28 which transfers replacement information for the cache memory 22. A refill 
engine-30 is connected to the cache access circuit 20 via a refill bus 32 which transfers replacement information, data 
items (or instructions) and addresses between the refill engine and the cache access circuit. The refill engine 30 is 

35 itself connected to the main memory 6. 

The refill engine 30 receives from the translation look-aside buffer 10 a full real address 34, comprising the real 
page address and line in page address of an item in the main memory 6. The refill engine 30 also receives a partition 
indicator from the translation look-aside buffer 10 on a four bit bus 36. The function of the partition indicator will be 
described hereinafter. 

40 Finally, the refill engine 30 receives a miss signal on line 38 which is generated in the look-up circuit 12 in a manner 

which will be described more clearly hereinafter. 

The cache memory 22 described herein is a direct mapped cache. That is, it has a plurality of addressable storage 
locations, each location constituting one row of the cache. Each row contains an item from main memory and part of 
the address in main memory of that item. Each row is addressable by a row address which is constituted by a number 

45 of bits representing the least significant bits of the address in main memory of the data items stored at that row. For 
example, for a cache memory having eight rows, each row address would be three bits long to uniquely identify those 
rows. For example, the second row in the cache has a row address 001 and thus could hold any data items from main 
memory having an address in the main memory which ends in the bits 001 . Clearly, in the main memory, there would 
be many such addresses and thus potentially many data items to be held at that row in the cache memory. Of course, 

50 the cache memory can hold only one data item at that row at any one time. 

Operation of the computer system illustrated in Figure 1 will now.be described but as though the partition indicator 
was not present. The CPU 2 requests an item from main memory 6 using the address in main memory and transmits 
that address on address bus 4. The virtual page number is supplied to the translation look-aside buffer 10 which 
translates it into a real page number 14 according to a predetermined virtual to real page translation algorithm. The 

55 real page number 1 4 is supplied to the look-up circuit 1 2 together with the line in page number 4a of the original address 
transmitted by the CPU 2. The line in page address is used by the cache access circuit 20 to address the cache memory 
22. The line in page address includes a set of least significant bits (not necessarily including the end bits) of the main 
address in memory which are equivalent to the row address in the cache memory 22. The contents of the cache memory 
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22 at the row address Identified by the line in page address, being a data item (or instruction) and the address in main 
memory of the data item (or instruction), are supplied to the look-up circuit 12. There, the real page number of the 
address which has been retrieved from the cache memory is compared with the real page number which has been 
supplied from the translation look-aside buffer 10. If these addresses match, the look-up circuit indicates a hit which 
5 causes the data item which was held at that row of the cache memory to be returned to the CPU along data bus 8. If 
however the real page number of the address which was held at the addressed row in the cache memory 22 does not 
match the real page number supplied from the translation look-aside buffer 1 0, then a miss signal is generated on line 
38 to the refill engine 30. It is the task of the refill engine 30 to retrieve the correct item from the main memory 6, using 
the real address which is supplied from the translation look-aside buffer 10 on bus 34. The data item, once fetched 

10 from main memory 6 is supplied to the cache access circuit 20 via the refill bus 32 and is loaded into the cache memory 
22 together with the address in main memory. The data item itself is also returned to the CPU along data bus 8 so that 
the CPU can continue to execute. In a direct mapped cache memory as outlined above, it will be apparent that the 
data item and its address recalled from the main memory 6 will be loaded into the storage location from which the data 
item was originally accessed for checking. That is, it will be over-written into the only location which can accept it, 

is having a row address matching the set of least significant bits in the line in page address in main memory. Of course, 
the page number of the data item originally stored in the cache memory and the data item which is now to be loaded 
into it are different. This "one to one mapping" limits the usefulness of the cache. 

To provide a cache system with greater flexibility, an n-way set associative cache memory has been developed. 
An example of a 4-way set associative cache is illustrated in Figure 2. The cache memory is divided into four banks 

20 B1 ,B2,B3,B4. The banks can be commonly addressed row-wise by a common row address, as illustrated schematically 
for one row in Figure 2. However, that row contains four cache entries, one for each bank. The cache entry for bank 
B1 is output on bus 26a, the cache entry for bank B2 is output on bus 26b, and so on for banks B3 and B4. Thus, this 
allows four cache entries for one row address (or line in page address). Each time a row is addressed, four cache 
entries are output and the real page numbers of their addresses are compared with the real page number supplied 

25 from the translation look-aside buffer 10 to determine which entry is the correct one. If there is a cache miss upon an 
attempted access to the cache, the refill engine 30 retrieves the requested item from the main memory 6 and loads it 
into the correct row in one of the banks, in accordance with a refill algorithm which is based on, for example, how long 
a particular item has been held in the cache, or other program parameters of the system. Such replacement algorithms 
are known and are not described further herein. 

30 Nevertheless, the n-way set associative cache (where n is the number of banks and is equal to four in Figure 2), 

while being an improvement on a single direct mapped system is still inflexible and, more importantly, does not allow 
the behaviour of the cache to be properly predictable. 

The system described herein provides a cache partitioning mechanism which allows the optimisation of the com- 
puter's use of the cache memory by a more flexible cache refill system. 

35 in the translation look-aside buffer 10 in the system described herein, each TLB entry has associated with the 

virtual page number, a real page number and an information sequence. An example entry is shown in Figure 3, where 
VP represents the virtual page number, RP represents the real page number and INFO represents the information 
sequence. The information sequence contains various information about the address in memory in a manner which is 
known and which will not be described further herein. However, according to the presently described system the infor- 

40 mation sequence additionally contains a partition indicator PI, which in. the described embodiment is four bits long. 
Thus, bits 0 to 3 of the information sequence INFO constitute the partition indicator. The partition indicator gives infor- 
mation regarding the partition into which the data item may be placed when it is first loaded into the cache memory 
22. For the cache structure illustrated in Figure 2, each partition can constitute one bank of the cache. In the partition 
indicator, each bit refers to one of the banks. The value of 1 in bit j of the partition indicator means that the data in that 

45 page may not be placed in partition j. The value of 0 in bit j means that the data in that page may be placed in partition 
j. Data may be placed in more than one partition by having a 0 in more than one bit of the partition indicator. A partition 
indicator which is all zeros allows the data to be placed in any partition of the cache. A partition indicator which is all 
ones does not allow any data items to be loaded into the cache memory. This could be used for example for "freezing" 
the contents of the cache, for example for diagnostic purposes. 

50 in the example given in Figure 3, the partition indicator indicates that replacement of data items which have that 

real page number in main memory may not use banks B1 or B3 but may use banks B2 or B4. 

It is quite possible to allocate more than one bank to a page. In that case, if the line in page address has more bits 
than the row address for the cache, the partitions would behave as a k-way set associative cache, where k partitions 
are allocated to a page. Thus, in the described example the real page number of Figure 3 can use banks B2 and B4. 

55 However, it may not use banks B1 and B3. 

The partition information is not used on cache look-up, but only upon cache replacement or refill. Thus, the cache 
access can locate data items held anywhere in the cache memory, whereas a replacement will only replace data into 
the allowed partitions for that page address. 
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Figure 4 illustrates In more detail the content of the refill engine 30. The refill bus 32 is shown in Figure 4 as three 
separate buses, a data bus 32a, an address bus 32b and a bus 32c carrying replacement information. The address 
and data buses 32a and 32c are supplied to a memory access circuit 50 which accesses the main memory via the 
memory bus 54. The replacement information is fed to a decision circuit 52 which also receives the real address 34, 

s the partition indicator P1 on bus 36 and the miss signal 38. The decision circuit 52 determines the proper partition of 
the cache into which data accessed from the main memory is to be located. 

The partition indicator PI can be set in the TLB like any other TLB entry. In the described example, the partition 
indicators are set by kernel mode software running on the CPU 2 and it is the responsibility of that kernel mode software 
to ensure that pages which should not be placed in a particular cache partition do not have their partition indicator bits 

10 set for that partition. However, a user may alter partitions by requesting that the cache partitions be altered. In that 
event, the CPU 2 would change to kernel mode to implement the request, change the TLB entries accordingly and 
then return to the user mode to allow the user to continue. Thus, a user can alter the partitioning behaviour of the 
cache, thus providing much greater flexibility than has hitherto been possible. 

The cache partitioning mechanism described herein is particularly useful for a multi-tasking CPU. A multi-tasking 

is processor is capable of running more than one process 'simultaneously'. In practice, the processor executes part of 
a process and, when that process is halted for some reason, perhaps in need of data or a stimulus to proceed, the 
processor immediately begins executing another process. Thus, the processor is always operating even when individual 
processes may be held up waiting for data or another stimulus to proceed. Figure 5 illustrates diagrammatical ly such 
a situation. On the left hand side of Figure 5 is illustrated the sequence which a processor may undertake to run different 

20 processes P1,P2,P3,P4. On the right hand side of Figure 5 is an illustration of where these processes may expect their 
data to be held in memory. Thus, the data for the process P1 are held on page 0. The data for process P2 are held on 
pages 1 and 2. Data for processes P3 and P4 share page 3. In the example, the processor executes a first sequence 
of process P1 , a first sequence of process P2, a second sequence of process P1 , a second sequence of process P2 
and then a first sequence of process P3. When the second sequence of the process P1 has been executed, the process 

25 pi has been fully run by the processor. It will readily be apparent that in a conventional cache system, once the proc- 
essor has started executing the first sequence of the process P2, and is thus requesting accesses from page 1, the 
data items and instructions in these lines will replace in the cache the previously stored data items and instructions 
from page 0. However, these may soon again be required when the second sequence of the process P1 is executed. 
The cache partitioning mechanism described herein avoids the timing delays and uncertainties which can result 

30 from this. Figure 6 shows the partitioning of the cache while the processor is running process P1 , and the change in 
the partitioning when the processor switches to running P3 etc. Figure 6 also shows the TLB cache partition indicators 
for each case. Thus, on the left hand side Figure 5 shows the cache partitioned while the processor is running processes 
P1 and P2. The process P1 may use banks B1 and B2 of the cache, but may not use banks B3 and B4. Conversely 
the process P2 may use banks B3 and B4, but not banks B1 and B2. This can be seen in the TLB entries below. This 

35 is, page 0 has a cache partition indicator allowing it to access banks B1 and B2, but not B3 and B4. Pages 1 and 2 
have cache partition indicators allowing them to access banks B3 and B4 but not B1 and B2. Page 3 has a cache 
partition indicator which prevents it from accessing the cache. Thus, any attempt by the processor to load data items 
from the process P3 into the cache would be prohibited. For the described process sequence, this however is not a 
disadvantage because, as can be seen, the processor is not intending to execute any part of the process P3 until it 

40 has finished executing process Pi . If it did for some reason have to execute P3, the only downside would be that it 
would have to make its accesses from direct memory and would not be allowed use of the cache. 

When the process P1 has finished executing, the processor can request kernel mode to allow it to alter the cache 
partition indicators in the TLB. In the described embodiment, kernel processes do not have access to the cache. Instead 
they modify the TLB entries for the partition indicators to modify the behaviour of the cache. The change is illustrated 

45 on the right hand side of Figure 6. Thus, now the cache partition indicators prevent the process P1 from using the 
cache at all, but allocate banks B1 and B2 to the processes P3 and P4, by altering the cache partition indicator for 
page 3 so that it can access these banks of the cache. Thus, when the processor is expecting to execute the process 
P3, it now has a cache facility. 

Some possible variations on the above described embodiment are mentioned below. 

50 in the described embodiment above, the address issued by the CPU on address bus 4 is split into a virtual page 

number 4b and a line in page 4a. However, the entire virtual address could be sent from the CPU to the look-up circuit 
for the cache. Conversely, the CPU could issue real addresses directly to the look-up circuit. What is important is that 
the cache partition indicator is provided in association with the address in main memory. 

In the embodiment described above, a single cache access circuit 20 is shown for accessing the cache both on 

55 look-up and refill. However, it is also possible to provide the cache with an additional access port for refill, so that look- 
up and refill take place via different access ports for the cache memory 22. 

In the described embodiment, the refill engine 30 and cache access circuit 20 are shown in individual blocks. 
However, it would be quite possible to combine their functions into a single cache access circuit which performs both 
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look-up and refill. 

As can be seen in Figures 2 and 8, each location in the cache holds an address in main memory and the item 
(data or instruction) from that address in main memory. It is not necessary for the whole of the memory address to be 
held at the cache location. For example the most significant bits of the address would generally be held to constitute 
5 a tag for that cache entry. This is known in the art and is not described further herein. 

A cache coherency mechanism will now be described. The operation types which alter the state of the data and 
instruction cache are shown in Table 1. 



TABLE 1 



Operation Type 


Effect 


Action 


Flush 


Make dirty data visible to other users. 


Writes last written value in cache to memory 


Purge 


Remove data from cache. 


Clears cache. 


ICohere 


Remove stale data from the instruction cache. 


Clears cache. 



Data coherency operations are ordered with respect to loads and stores which access items in memory at ad- 
dresses in main memory within the range of the operation. For example, a "store" followed by a flush' to an overlapping 
part of the address space will ensure that the flush operates on the newly written data. The operations are executed 
20 in user mode. A user mode thread must have either read or write permission for the page on which the operation is to 
be performed. 

Each of the coherency operations are provided to operate on both lines and partitions. The line operations are 
described herein for the sake of completeness although they do not form part of the present invention. 

25 Line Operations 

Line operations allow cache control of individual lines. A line is specified by any byte address contained with the 
line. These instructions are intended to make it easy to construct optimizable loops of instructions which will operate 
on a given address range. For example, to purge a given buffer from the cache, the purgeline instruction is executed 
30 in a loop with the first address operand being the start of the buffer and subsequent addresses being the start address 
of subsequent cache lines. The loop ends when the address exceeds the end of the buffer. The size of the cache line 
is defined by the implementation, which for the described embodiment is 32 bytes. 

Partition Operations 

35 

The partition-based instructions use an address to determine, via the relevant TLB entry, which one of a set of 
partitions are to be acted upon. The instructions will then operate upon a line within one of these partitions which the 
address could replace. 

The partition-based instructions are intended to be used in a sequence of instructions. The following conditions 
40 will perform the operation on the whole partition in which the page containing address could be replaced: 

• Address is initialised to the address of the first byte in the page. 

• The partition operation is repeated with the same address once for each partition the data may be able to reside in. 

45 

• Address is incremented until the offset within the page reaches the partition size. Repeating the partition operations 
at each increment. 

In the described embodiment, the smallest page size is at least as large as than the partition size. Therefore using 
so the operations on a single page will operate on the whole partition. 

If software uses the address of a byte larger than the partition size within the page, this will map onto a line in the 
cache which has already been operated upon. Therefore the code will run correctly, but there will be a performance 
penalty in performing a needless instruction. 

The partition-based instructions use the address (and therefore the partition identifier) to identify a set of lines in 
55 the cache. One of this set is then acted upon, whether the specified address matches the address in main memory 
held in the cache or not. Only partitions which have their PI bits clear will be changed by these instructions. That is, 
the coherency instructions will operate only on those partitions which the running process has access to. 

The present cache coherency mechanism provides the following instructions. In these instructions, the denotation 
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dmem refers to the main memory of the computer system. 
Flush 

These instructions are provided to make certain that dirty data is visible to other users. That is, the item held at 
the relevant cache location is written back to the address in main memory held at that cache location with the item. 



f lushline 



flush a line 

base, offset unsigned (x) unsigned (x) 

Ensure that all previous writes to the line containing 
dmem [base+off set] are visible to other users sharing this 
data. 



f lushpart 
flush a partition 

base, offset unsigned (x) unsigned (x) 



Flush a dirty cache line which could be replaced by a memory 
access to dmem [base+off set] . 

Flushing a line ensures that all previous writes to that line 

are visible to other users sharing this data. 

If all replaceable lines are clean the instruction has no 

effect. 



Purge [for data itemsl 

These instructions are provided to remove data from the cache - they write back data items in the cache to ad- 
dresses in main memory specified with those items, then invalidate the cache contents. 



purge line 



purge a line 

base, offset unsigned (x) unsigned (x) 

Write back to memory any dirty items in the line containing 
dmem[base+of f set] and invalidate the line in all cases 
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purge a partition 

base, offset unsigned (x) unsigned (x) 



Purge a valid cache line which could be replaced by a memory 
access to dmem [base+of f set] . 

A line is purged by writing to memory any dirty data it 
contains and then invalidating the line. 

If all replaceable lines are invalid the instruction has no 
effect . 



[Cohere [for instructions! 

These instructions are provided to make certain that subsequent instruction fetches do not read stale data from 
the instruction cache. 



icohereline 



make coherent a line in the instruction cache 
base, offset unsigned (x) unsigned (x) 



Invalidate the instruction cache line containing 
imem [base+of f set] . 



icoherepart 



make coherent a partition in the instruction cache 

base, offset unsigned (x) unsigned (x) 

Invalidate a valid instruction cache line which could be 

replaced by a memory access to imem [base+of f set] . 

If imem [base+of f set] is not cacheable 7 the instruction has n< 

effect. 

If all replaceable lines are invalid the instruction has no 
effect . 



In another embodiment, the partition-based flush instruciton can have the following form. In the following instruction, 
var<a:b> is bits a to b of the variable var. 
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flushpart 

flush a partition 
s base, offset unsigned (x) unsigned (x) 

addr<-base + offset 
addr0<12:63><-addr<12 :63> 
For index=#, index<4096 , index+=32 
,o addrtf><0 : ll>=index<0 : 11> 

Flush a plurality of dirty cache lines whcih could be 
replaced by a memory access to dmem [addr<ft] 



The purge and incohere instructions can take a similar form where a single instruction is to operate on a plurality 
of lines in the cache. 

Clearly, the above described instructions are valid for the case where a cache is not partitioned, that is it can be 
considered that the whole cache is a single partition. 

20 

Claims 

1 . A cache coherency mechanism in a computer system comprising a processor, a cache and main memory wherein 
a plurality of addresses in main memory have access to each location in the cache, wherein a process being run 

2S by the processor includes a cache coherency instruction which specifies (i) an operation to be executed on the 

contents of a location in the cache and (ii) an address in main memory, the operation being executed for the 
contents of the location in the cache which could be filled by an access to said address in main memory, if the 
running process normally has access to said address in main memory, regardless of whether or not the contents 
of the specified address in main memory are held at that location in the cache. 

30 

2. A cache coherency mechanism according to claim 1, wherein the contents of each cache location comprise an 
address in main memory and an item stored at that address in main memory. 

3. A cache coherency mechanism according to claim 2, wherein the cache coherency instruction is a flush instruction 
35 which writes back to the address in main memory held at that cache location the item held at said location in the 

cache. 

4. A cache coherency mechanism according to claim 1 or 2, wherein the cache coherency instruction is a purge 
instruction which clears the contents of said location in the.cache. 

40 

5. A cache coherency mechanism according to any preceding claim, wherein the cache coherency instruction spec- 
ifies a sequence of addresses in main memory and operates for the contents of a set of locations in the cache 
which would normally be filled by accesses to the addresses in said sequence. 

45 6. A cache coherency mechanism according to any preceding claim, wherein the cache is partitioned into a plurality 
of cache partitions and wherein the cache partition containing the relevant location in the cache is determined in 
dependence on the specified address in main memory. 

7. A cache coherency mechanism according to any preceding claim, wherein the main memory is organised in pages, 
50 each page comprising a sequence of addresses and wherein the cache coherency instruction specifies a page in 

main memory for which the operation is to be executed, the operation being executed for each of the sequence 
of addresses in the specified page. 

8. A cache coherency mechanism according to claims 6 and 7, wherein the number of addresses in each page is 
55 always at least as great as the number of locations in one of said cache partitions. 

9. A cache coherency mechanism according to any preceding claim, wherein the cache, or each cache partition, 
when present, is direct mapped. 
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10. A computer system comprising: 

a processor for running a process by executing a sequence of instructions; 
a main memory which holds said instructions and data for said instructions; and 

a cache connected in a memory access path between the processor and the main memory and having a 
plurality of storage locations, wherein a plurality of addresses in main memory have access to each storage 
location, 

wherein the sequence of instructions for execution by the processor includes a cache coherency instruction 
which specifies (i) an operation to be executed on the contents of a storage location in the cache and (ii) an 
address in the main memory, wherein the specified operation is executed for the contents of the storage lo- 
cation in the cache which could be filled by an access to said specified address in main memory, if the running 
process normally has access to said address in main memory, regardless of whether or not the contents of 
the specified address in main memory are held at that location in the cache. 

11. A computer system according to claim 10, wherein the processor has a user mode of operation and a privileged 
mode of operation and wherein the cache coherency instruction is executed in the user mode. 

1 2. A method of modifying the coherency status of the contents of a cache with respect to items held in a main memory, 
wherein a plurality of addresses in main memory have access to each location of the cache, the method comprising: 

executing a cache coherency instruction which specifies (i) an operation to be executed the contents of a 
location in the cache and (ii) an address in main memory; 

responsive to said cache coherency instruction, executing the specified operation for the contents of the lo- 
cation in the cache which could be filled by an access to said address in main memory, if the running process 
normally has access to said address in main memory, regardless of whether or not the contents of the specified 
address in main memory are held at that location in the cache. 

13. An instruction set for a computer system which includes a cache coherency instruction which specifies (i) an op- 
eration to be executed on the contents of a location in a cache and (ii) an address in main memory, the cache 
coherency instruction causing the specified operation to be executed for the contents of the location in the cache 
which could be filled by an access to said address in main memory, only if the running process normally has access 
to said address in main memory, regardless of whether or not the contents of the specified address in main memory 
are held at that location in the cache. 
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